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Hybrid Sensing Techniques for Positioa Deteriiiinatioii 
Field of the Invention 

5 The present invention relates to methods and apparatus for spatial location and translation 
measurewient. More particularly although not exclusively, the invention relates to non-oontact 
optical metliods and apparatus for measuring the location and translation of a device in 
relation to a position-encoded surface. Such methods and apparatus can be used for accurately 
determining the position of printing, pointing or analogous devices on a writing surface or a 
10 printed page. 

The inventioii also relates to methods and apparatus for improving the accuracy and error- 
tolerance of non-contact optical position measuring systems. In particular, the invention 
relates to improvements in the error-correction capability of position-sensing pointing, 
15 printing and digitizing devices. 

Background to the Invention 

Pointing, printing, digitizing and similar devices are concerned at various levels vsdth detecting 
20 a peripheral device in relation to a fixed reference point The precise position sensing 
tiirangement which is chosen depends on the particular task which Ihc device is to achieve. 

Relative motion sensing is used to control a cursor, for example, by means of a mouse 
incorporating a ball/sensor mechanical arrangement. This type of device detects Incremental 
25 displacements transmitted to the sensors by the balls movement and thus the motion of the 
mouse in relation to the fixed svirfece can be used to control the position of an on-screen 
cursor. Sucii a technique however, does not provide absolute position information as there is 
no fixed reference point and each time the mouse is lifted and replaced on the mouse surface, 
there is no way of detecting its location. 
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Non-contact techniques for measuring relative displacement also exisL Optical devices using 
svich techniques employ an CCD sensor which images a fixed, patterned surface. For 
example^ the movement of an optical inouse is detected by imaging the movement of elements 
5 of a fixed surface pattern or texture jto provide a translation vector and thus x and y cursor 
displacements. > 

These relative position measurement 'devices require a specific surface upon which to operate. 
In tile former case, a rolling surface is used. In the latter, an optically patterned surfece. 
10 ' 

To extend relative position measurezijient techniques to arbitrary sur&ces> methods have been 
developed which exploit the interaction between an incident and a reflected light beam which 
is shone onto a surface. 

IS An example pf this is US patent number 6,330,057 Bl to OTM Technologies Ltd, The 
technique provides a vector output j based on heterodyne or homodyne detection of non- 
doppler, non-speckle image signals derived £rom changes in tiie phase and/or the amplitude of 
reflection from an optical surface. Xhis technique allows any suitable optical surface to be 
used as the reference surfeoe, iniparticul^ paper. It also allows the possibility of 

20 communicating translation signals to a computer system by moving a suitable object in the 
field of view of the stationary device such as by means of a gesture. 

Absolute position measuring techniques fall into the broad category of devices which rely on a 
fixed "position-encoded" surface which is imaged in order to determine the absolute location 
25 of the imaging system and thus device in relation to the surface. These systems use a "glyph 
bed". A glyph bed is an array of visible markings which encode absolute locations on the 
surface. Depending on the encodingi technique, a glyph can encode a position on a logical 
page area which is extremely large, I^or example, WO 01 26032 Al to Anoto AB implements a 
glyph array aligned on a virtual gridiwWi the positions of glyph marks in relation to the grid 
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tepresenttng data values. WO 0126032 Al describes a 4-bit cyclic encoding algoritiiin 
capable of encoding an extremely logical area- Other examples of absoittte position 
encoding systems include US patent 5,852,434 to Sekendur which describes an absolute 
position measuring system whereby the position location is encoded into monolithic optically 
5 readable symbols arrayed on a grid on a page. 

In boih cases, a pen device is used which incorporates an unagtng system in addition to a 
writing function. WO 0126032 Al shows an example of such a device. The pens imaging 
system records the data encoded in the glyph or glyph bed in the field of view of the pen as 
10 strokes or pen "clicks" are executed. The time-varying absolute pen position, or (x, y, t) data 
are recorded by an associated computer. x " 

A significant problem in absolute optical position measurement systems is obscuration of the 
glyph bed. This can result from overprinting with infrared opaque inks, damage to the paper 

15 and other affects which damage or obscure the position encoding glyphs. Obscuration causes 
the pen to lose sight of tl^ glyph bed and if error correction or interpolation is not successful, 
stroke capture will be incomplete and/or error-laden. This problem can, to an extent, be 
overcome by restricting overprinting of human-readable matter lo infrared transparent iri& so 
that the pen can see through tiie overprinted areas. However, this solution is not ideal as it can 

20 introduce complications in terms of ink delivery during the printing process and.may limit the 
available colour selection and production techniques. 

Effective obscuration can also occur where the glyph bed is printed at a lower tlian nonnal 
resolution. Tn such a situation it is possible thai the transient error-rate of stroke detection is 
25 safiiciently high to produce positioning ennors and subsequent stroke data errors. 

This problem is inhibiting the progress and adoption of these technologies and a solution to 
this difSculty is theretbrc highly sought-after. The invention attempts to overcome or at least 
ameliorate some of the abovementioned difficulties by providing an absolute non-contact 
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optical absolute location system wliich is higMy error-tolerant and resistant to obscuration 
eifects in glyph detection. The inveatioa also- provides an improved optical non-contact 
absolute position measurement system which is suitable for low glyph resolutions. 

5 Disclosure of the Invention 

In one eispect, the invention provides for a metliod of determining the time-vai'ying absolute 
position of device in respect to a surface, the method comprising the steps of: 
measuring at least one absolute position of the device in respect to the sxirface; 
10 me^uring a time-varying vector representing the movement of the device in respect to the 
sur&ce; and 

iniiialisLng the position of vector to ttie at least one absolute position measurement thereby 
measuring the absolute position of the vector and thus the time-varying absolute position of 
the device. 

15 

In a further aspect, the invention provides a method of determining the absolute position of a 
stroke made by a measurement device in respect to a surface, said surfoce having embedded 
thereon position encoding indicia, the method comprising the steps of: 

detecting one or more position encoding indicia and thereby calculating at least one absolute 
20 position measurement of the device; 

in coiqunction with the aforementioned step, measuring the relative movement of the device in 
respect to the surface and thereby calculating a lime-vaiying motion vector repiescuiting the 
movement of the device in respect to the surface; and 

calculating the absolute location of the stroke in respect to the surface on tlie basis of at least 
25 one measurement of the absolute position in combination with the time-varying motion vector. 

Preferably, the detection of the absolute position is achieved by non-contact optical means. 
200208371 22/10/2002 10:03 
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Preferably, ihe detection of the time-varying vector is achieved by means of a non-contact 
relative optical measurement* 

The detectjon of the at least one absolute position may be performed by Imaging a glyph bed 
5 applied to the surface. 

The glyph bed is pxefersAly a machine-readable array of markings having absolute positions 
encoded therein. 

10 The glyph bed is preferably invisible to the human eye or alternatively adapted to no 
substantialiy interfere witli the appearance of the surface when viewed by the himian eye* i 

The glyph bed may be applied using inks which are visible in the infrared part of the spectrum. 

1 5 The surface may be overprinted with human-readable material in such a way as to obscure a 
portion of the ^yph bed. 

The detection of tlie relative position of the time-varying vector representing the movement of 
the device in respect to the surface is preferably measured using optical means. 

20 

Preferably the detection of the relative position of the time-varying vector representing the 
movement of the device in respect to the surfiice is preferably measured using heterodyne or 
homodyne detection of non-doppler, non-speckle image signals derived from changes in the 
phase and/or the ampUmde of reflection from an optical surface. 

25 

Alternatively, the detection of the relative position of the time-vatyiDg vector representing the 
rnovement of the device in respect to the surface may be measured using a transducer-based 
anangement. 
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In a furflier aspect, the invention provides a measwenent device for determining Uie time- 
varying absolute position of the device in respect to a surjfiice incJuding: 
a first measuring device airatiged to determine at least one absolute position of the device in 
respect to the surfece; 

a second measuring device pranged to determine a tixne-varying vector representing the 
movement of the device in respect to the surface; 

processing means adapted to initiajise the position of vector to the at least one absolute 
position measurement and output a signal representing the absolute position of the vector and 
thus the time-vatying absolute position of the device. 



In a further aspect, the invention provides a measurement device for detennining the absolute 
position of a stroke made by the measurement device in respect to a surface^ said surface 
having embedded thereon position encoding indicia, the measurement device including: 
a first measuring device arranged to detect one or more position encoding indicia and 

15 determine at least one absolute position measurement of the device; 

in coiyunction with the aforementioned step, a second measuring device arranged to measure 
the relative movement of the device in respect to the surface and output a time-varying 
motion vector representing the movement of the device in respect to the surface; and 
processing means adapted to calculate the absolute location of the stroke in respect to the 

20 surfece on the basis of the at least one measurement of the absolute position in combination 
with the measxjrement of tire time-vaiying motion vector. 

In a preferred embodiment, the device includes a first and second optical system, the first 
adapted to image a glyph bed aiTanged to encode the absolvite position onto the surfiice, and 
25 the second optical system adapted to determine the relative movement of the device in respect 
to the surface. 

The first and second optical systems may be incorporated into a common optical sensing 
device. 
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The device preferably has a pen form-factor or altennatively, a mouse fotm-factor or other 
ad^ted to its use or application. 

5 The device may include additional support circuitry adapted to store stroke data. 

The device may include communications circuitry adapted to transmit stroke data to a control 
means such as a computer. 

10 The device may operate by buffering the stroke data for iiser-activated uploaxi, or 
communicate the stroke data in real-time, ox be responsive to a, users command to uj^Joad 
stroke data to a control means. 

In a further embodiment; the method may further include the step of, where the detection of 
15 absolute stroke position is interrupted, attempting to interpolate across the internqjted area.^ 

The method may further include tlie step of sanity dbecking interpolation and stroke 
reconstruction based on the statistically possible locations of strokes applied to the surfaceV 

20 The method may also uiclude the step of general sanity checking absolute position 
measurements in respect of the sequence of stroke detection events of a surface by reference 
to user ergonomics, physical size of the surface, type of stroke applied or the speed of 
application of the stroke. - 

25 The method may include the step of providing feedback to a user as to whether tlie stroke 
detection is successful or not, preferably in real time. 

The method may be adapted to detect the absolute position of a pkuiality of strokes, said 
strokes constituting writing, wherein sanity checking of the absolute position detection is 

200208371 22/10/2002 10;03 
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perfonned based on a forward looking probabilistic algorithm responsive to the physical 
writiTig environment and process. 

Detailed Descriptioit of Preferred Embodiments of the Invention 

5 

The invention will now be described by way of example only and with reference to the 
drawings in which: 

Figure 1 : illustrates details a series of strokes applied to a surface with embedded position 
10 ' encoding infonnation; 

Figure 2: illustrates an example of a stroke series applied to a mixed content sur&ce; 

Figure 3: illustrates normalisation of a stroke to an absolute location on an embedded 
1 5 position encoded surface; and 

Figure 4: illustmtes a simplitied schematic of a pen forming a stroke and the c^tiiring 
stroke data. 

20 The following description will be provided in the context of non-contact optical absolute 
location measurement combined with non-contact optical relative movement measurement 
Other techniques for detecting the former of these parameters are possible and include 
detecting conducting particles embedded in die surface or magnetic regions arranged so that a 
transducer detects a signal representative of its location on the surface. In terms of the latter, 

25 other devices may be used and these include mechanical transducers to sense displacement 
and speed of the detecting device and electromagnetic systems to ineasure movement of the 
device over the surface. 
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The optical solution represents the most preferred embodiment as this arrangeinent does not 
require mechanical transducer components and a significant degree of compactness and 
lightness 15 required in a pen form-factor. 

5 Figure 1 illustrates a series of strokes 30, 33, and 34 applied to a surfece. A stroke is defined 
as a single contiguous marking applied by a user to a surface using a pen. A stroke has a start, 
an end and an intermediate portion connecting the two and a stroke is broken if tine pen is 
lifted from the surface. Thus, the clement 30 in Figure I corresponds to a stroke as it is formed 
by a single marking action with a start at 35, an end at 31 and an intermediate portion in 
10 between. The stroke in this case is formed by a user diawng in the direction indicated by A, 

The stroke 30 is applied to a surface 10 which has embedded thereon a position encoded glyph 
bed 1 L Tlie glyph bed may be implemented in a number of ways and is therefore indicated in 
a schematic form as a background grid, 

15 

Tn a conventional optical non-contact absolute position measurement system such as that 
shown in Figure 4, a user writes with a special pen 50 on a glyph embedded Siu-face 10. -The 
pen 50 senses contact with the writing surface and begins capturing image data. The sending 
step may be done using a pressure sensor or using an analogous transducer actangement. As 
20 the stroke is applied to the surface, the pen records a series of images of the field of view 5 1 . 
This can be done using a CCD device and memory along with a microprocessor programmed 
suitably. 

Image capture is strobed at a suitable ftequency to ensure that the stroke is smoothly digitized. 
25 Each captured image 51 is processed to decode the image and extract the position information 
which is encoded into the glyph bed that is visible to the pen. Various con-ections and 
calibrations to take into account pen rotation and orientation may be carried out. Details of 
these may be found in the documents referred to above and are not material to the present 
invention. 
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The absolute position decoding function may be performed by the pen itself, or alternatively 
by a control means such as a computer. It is noted that there exists various methods of 
handling the captured image data and decoding tlie position information. According to the 
5 preferred embodiment, the position data is streamed to the control means by means of a 
corrrmLinications circuit (not shown) . 

Actual data transmission may be effected using a wired link such as a serial or USB 
connection. Alternatively, the pen may include a wireless interfece such as Bluetooth or 
10 similar. As the stroke is formed and the strobed images recorded and decoded^, a series of 
digitized absolute positions are recorded. These can be expressed as (xj,yfjj), (X2,y3j^, 
f^jiys'tsi)' - (Xf,yutO' A complete set of data specilying tlie stroke is recorded and then passed to 
's^chever application is being used to intopret the pen output 

15 Returning to Figure 1, stroke 30 is digitized as a series of (x,y,t) coor^Unates and stored on the 
control means. When the pen is lifted, image recording is disabled. The next stroke begins at 
the point 32 and follows the direction indicated by B. Thus, for a series of strokes applied to a 
position-encoded surface 10, and assuming complete visibility of the background glyph bed, a 
complete digitized representation of tlie series of strokes p.e,; a word) can he obtained. 

20 . 

Howev^, in many real situations, the background glyph bed may be obscured by paper 
damage or, more significantly, overprinting. This situation is illustrated in Figure 2. 

Here, a Ibnn is printed on a position-encoded surface 1 ) . Tlie fomi includes infra-red (IR) 
25 opaque overprinting 18 and 21. The text "A" and "B" refer to indicia accompanyiog the check 
boxes 2L A letter 13 is entered by a user iirto checkbox 21 and can be considered as a 
single stroke as it is possible to fomi this letter widioat lifting the pen. The stroke has crossed 
checkbox 21 at points 13 and 14 and thus the overprinting has obscured the background glyph 
bed. In some cases this may not be particularly problematic, as the pen may include 
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intelligence which interpolates between highly proximate stroke stops and starts- However, Tor 
a large number of obscviralion events, the overall accuracy of the stroke recording may be 
significantly compromised. This may be caused by repeated crossings of an overprinted area 
or obscuration of a significant part of a stroke. 

5 

In Figure 2, portions of the letters "j^" and "w" would be intermpted where the pen "loses sight" 
of the backgrouud glyph bed as the pen crosses the overprinted areas at 1 3» 16 and 14 and 17, 

Examples such as 17 where the pen has "grazed" the overprinted area may be particularly 
10 problematic as a significant amount of stroke data can be lost as the glyph bed remains 
obscured for a relatively large pajt of tfie stroke portion. Assuming no interpolation is 
possible between proximate stroke positions, the effect of this would be to capture stroke d ata 
tiiat is "chopped" where the liser writes on overprinted parts of the form or document. 

15 Although a reader may be able to visually interpolate betweoi broken representations of the 
strokes, if the stroke is used to produce a command outptxt as in the case of ticking a checkbox 
or pen-clicking on a specified coded area, the data loss will be even more significant. 

A more extreme case of obscuration is shown in Figure 3. Here a block of overprinted area 44 
20 is completely obscuring the glyph bed 11 on the surface 10 below it. If a user writes a letter 
40 as shown, most of the stroke data remains uncaptured as the pen remains "lost" while 
imaging the area of the primary part of the stroke. As the stroke leaves the overprinted block al 
41, the pen regains sight of the glyph bed and absohtfe position data is recorded. The resulting 
data record corjcespotiding to this letter obtained from optical absolute location measurement 
25 would be virtually completely corrupted. 



To compensate tor these effects, the invention fimctions as follows. The preferred embodiment 
discussed here is fociissed on the use of non-conlact optica) imaging systems. 
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Returning to Figure 4. a pen constructed in accordance of an embodiment of the invention 
captures both absolute position data as well as recording relative displacements. The relative 
displacements can be expressed as a scries of velocity or displaceinent measuiCTcients 
(Ahti),( A2^t'2),( A^,t^...( Aut^ in the sense that a series of measurements representing the 
5 velocity vector of the device are sequentially recorded. In this mode, the pen records the 
movement of the sur&ce under the pen while the pen is in contact with the surface. Again this 
may be detected using a pressure sensor. 

In this mode of operation^ the pen can be tliou^t of as completely analogous to a transducer 
10 or optical mouse. Displacements are measured relative to tiie starting point of the movement 
assuming that the device is resting on the surface or, in the case of a pen, applying a stroke to 
the paper surfece. 

There are a ntmaber of optical techniques for detecting relative movement. Tliese include 
15 speckle velocimetry in which either a transmission pattern or a pinhole is used to modulate the 
speckle image. Wlieii a pinhole is used, tlie detected signal represents the passage of 
individual speckles across the pinhole and thus the displacement can be calibmted and output 
Tn homodyne or heterodyne Doppler measurement techniques, a coherent light source is split 
into two beams. The primary beam illuminates the object whole velocity is to be measured. 
20 The other, reference, beam is reflected from a reference element. The reference element is 
usually a mirror which is part of the measurement system* The light reflected from the object 
and from the reference element are rccombincd, usually by the same beam splitter, and 
directed into a light-sensitive detector. The frequency of the light reflected from the object is 
shifted due to the doppler effect, in proportion to the object velocity component along the 
25 bisector between the primary beam and the reflected beam. Thus, if the reflected beam 
coincides with the primary beam, axial motion can be detected. 

US 6,330,057 describes a method whereby a surface is illuminated by a source so that the 
incident illumination Is diffusely reflected from portions of the surface towards a detector. 

200208371 22/10/2002 10:03 
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I The diffuse reflected light is spatially filtered so that the phase of the detected illumination 

j from a given scatterer on the surfiice is constant or linearly proportional to the translation of 

the surface. A signal is generated by the detector responsive to the illumination incident on the 
j detector and the relative motion of the surface in a direction parallel to the surface. The 

i 5- surface iB illuminated through a partially reflecting object placed in adjacent to the surface 

j where the light Is transmitted to the detector by way of reflection or diffraction. 

i 
I 

: Retuming to Figure 4, when the pen is used to apply a stroke to the surface, a pressure sensor 

or similar triggers data capture. Simultaneously with detecting the pens absolute position the 
relative motion of the pen over the surface is measured. This can be expressed as a series of 
vectors representing the time- varying direction and velocity of the pen in relation to the 
suz&cc 10. Thus the stroke in its entirety can be parameterised as a free-floating stroke 
element. 



10 



15 A stroke vector measured on this basis has no absolute position information, so it "floats" in 
same way that a mouse can be used to trace out a floating portion of a shape on a monitor. . 

This is shown in Figure 3, whereby a stroke vector 42 for the letter y 40 is shown floatii^ on 
the surface 1 1 in an arbitrary position. The relative motion measurement functions even in the 
20 presence of overprinting or other imperfections in the surface and records the shape of the 
pens movement. However, according to this embodiment of the invention, the pen measures 
this shrol^ vector simultaneously wilh at least one measurement of the absolute position. This 
assumes that it would be highly unlikely that a stroke would be completely confined within an 
overprinted area. 



25 



While this constraint may not always be satisfied, it is reasonable that it will hold for the 
m^ority of standard document formats and circumstances. If the absolute position 
measurement technique which was chosen did not rely on glyph visibility, this situation can be 
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compensated for. So long as one measurement of absolute position is recorded for any single 
stroke^, the floating relative stroke data 42 can be noijmalised to that position. 

The stroke is translated to its true position 40 by normaliztng it according to the vector as 
5 shown in Figure 3, Tn a practical implementation it is necessary to detect when a stroke is 
being applied and use this signal as the trigger for recording the relative movement of lie pen 
ajid» if not obscured, the position of the pen in relation to the glyph bed. 

A sequence of strokes corresponds to a letter, word or phi"ase. Of course, other notations ace 
10 possible such as checkbox filling annotations found in fbtm applications, Tn operation, the 
recording of the complimentary data, the absolute and relative sti-oke data would provide a 
continuous corrected output to Oie controlling device or other interpreter mechanism- In 
situations where no absolute data is lost, the processing requirements of the pen may be 
dynamically adjxisted to take into account varying memory requirements a3 v^ell as data 
15 manipulation. 

In a further embodiment, the data processing system may apply some sanity checking rules for 
normalising -fee relative stroke information. For example, when constraining a floatmg stroke, 
it is a safe assumption that the writer intended the stroke to be vwritten somewhere on the 
20 present page. Thus the target area for normalising the stroke data is constrained according to 
the physical writing environment 

Anotlier type of sanity checking is where the pen attempts to interpolate where absolute 
position data is lost This may be m regions where the stroke data was interrupted suddenly 
25 with no attendant lifting of the pen from the page. Thus for small areas of data loss, for 
example, such as where a stroke traverses a very small overprinted region, the system may be 
programmed with extrapolation tolerances wliich will simply join the ends of the broken 
absolute location stroke data in such circumstances. 
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Oilier methods may include forward-looking statistical treatments to determine the location 
where a stroke should be normalised. This method may implement a set of ndes for predicting 
where a floating stroke belongs based on the previous stroke positions and various 
assumptions about where- the next stroke will be located- These parameters are necessarily 
5 flexible, but m^y include factors such as proximity to the edge of the page, characteristics of 
the users handwriting and similar issues. In cases where some form of optical character 
recognition is implemented, some predictive text functionality could be used to constrain the 
location of floating strokes in order to rebuild the written material and properly digitise its 
location, 

10 

There are a number of applications in w4ijch the invention may find use. Foremost is in form- 
filling applications where a composite page would include a glyph bed of absolute location 
coded material, large amounts of overprinting including checkboxes, text boxes and guide 
areas for the insertion of handwritten texL Other applications include position-^encoded media 
15 such as magazines, newspaper and paper-based web interface. The risk of glyph obscuration is 
particularly high in the case of magazines and newspapers which nonnally contain large areas 
of printed material with overprinted text. Essentially these types of media have relatively little 
clear area where a pen could image the absolute location g\yph background. V 

20 A pen suitable for use with the invention may be constructed using presently available 
techniques and there exist a number of variations in the specific construction such as raemoi^ 
capacity, data iqiload and communication technique. There is also some flexibility in where 
the onrthe-fly normalisation calculations are performed. This function may be hard- 
programmed into the pens microprocessor itself or handled remotely by a controlling means. 

25 The controlling means will generally be a computer on which is running the interpretation 
program which provides the data input interface to tiie selected application. The normalisation 
step could equally be performed by a, networked machine although this may have 
consequences in terms of latency. 
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An advantage of the invention is thai the accuracy of the stroke capt\ire is not dependant on 
the resolution of the glyph bed. The highest precision is usually needed when capturing 
handwriting. In this case, it does not usually matter exactly where the handwritten stroke 
starts, but it is necessary to very acctirately capture the relative stroke data. The invention 
5 allows the use of a less accurate absolute position detection method when combined with an 
accurate relative measurement technique* This is beneficial where a lower fidelity printing 
system and hence lower resolution glyph bed is appHed to the writing surface. Also, this 
feature allows fewer image captures of the absolute position data while retaining effective 
capture of the relative motion. 

10 

Specific embodiments of the pen may include features such as audible or sensory feedback to 
indicate to the usex whether successful error-cotrection has been achieved. This is most likely 
to be effective as a failure warning whereby the system signals to the user when it has not 
sensibly interpreted a stroke. 

15 

Such variations in the implementation of the invention are understood to be within the purview 
of one skilled in the art and will not be discussed in detail. 

The invention thus provides an accurate solution to enror-correclion failures in non-contact 
20 absolute position measurement systems. It is also oost-eflfecti ve given that some duplication of 
optical and processing elements is possible when producing a suitable pen. Other form factors 
may be. possible and the invention may be combined with other digitizing technologies and 
situations depending on the application and degree of error correction reciuired. 

Although tlie invention has been described by way of example and with reference to particular 
25 embodiments it is to be understood that modification and/or improvements may be made 
without departing from the scope of the appended claims. 

Where in the foregoing description reference has been mads to integers or elements having 
known equivalents, then such equivalents are herein incorporated as if individually set tbrth. 
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Claims 

1. A method of delerminine the time-varying absolute position of device in respect to a 
5 sutfece, the method coinprisirig the steps of. 

measxiring at least one absolute position of the device in respect to the surface; 
measuring a tijne-varying vector representing the movement of the device in respect to 
flic surface; and 

10 initialising the position of vector to the at least one absolute position measurement , 

thereby measuring the absolute position of the vector and- thus the time-varymg^v 

absoiute position of the device. , f; 

■ ■ 

2. A method of detertnining the absolute position of a stroke made by a measui-enisnt * . 
15 device in respect to a sur&ce^ said surface having embedded thereon position encoding 

indicia, the method comprising tlie steps of: ' f ' 

detecting one or more position encoding indicia and thereby calculating at least\'one: , 
absolute position measurement of the device; ' 
in conjunction with the aforementioned step, measuring the relative movement of the ^ 
20 device in respect to the SLuface and thereby calculating a time-varying motion vectbr 

representing the movement of the device in respect to the surface; and 
calculating the absolute location of flic stroke in respect to the stirfece on the basis of at 
least one measui^ment of die absoiute position in combination with the time-vai'ying 
motion vector, 

25 

3. A method as claimed in either claim 1 ox 2 where the detection of the absolute position 
is achieved by non-contact optical means. 
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4, A method as claimed in any preceding claim wherein the detection of the time-varying 
vector is achieved by means of a non-contact relative optical raeasiorement. 

5- A method as claimed In any preceding claim wherein the detection of the at least one 
5 absolute position is performed by imaguig a glyph bed which is applied to the surface. 

6, A method as claimed in claim 5 wherein the glyph bed is a machine-readable array of 
markings having absolute positions encoded tlierein, 

7. A method as clmroed in claim 5 or 6 wherein flie glypb bed is invisible to the human 
eye or alternatively adapted to not substentially interfere with the appearance of the surface 
when viewed by the human ej'^e. 

. 8. A method as claimed in any one of claims 5 to 7 wherein the glyph bed is applied 
15 using ink which is visible in the in&ared part of the spectrum. 

r 

9. A method as claimed in any preceding claim wherein the stcrface is overprinted with 
Iniman-readable material in such a way as to obscure a portion of the glyph bed. 

20 .10. A method as claimed in any preceding claim wherein the detection of the relative 
• position of the time-varying vector representing the movement of the device in respect to tiie 
^ surface is preferably measured using heterodyne or homodyne detection of non-doppler, non- 
speckle image signals derived firom changes in the phase and/or the amplitude of reflection 
from an optical surfece. 

11. A method as claimed in any one of claims 1 to lO wherem the detection of the relative 
position of the time-varying vector representing the movement of Ihe device in respect to the 
« surface is measured using a transducer-based arrangement. 



1 
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Abstract 

Hybrid Sensing Techmques for Position Petermuoiatioii 

The invention provides for a method and apparatus for improving error-correction in non- 
5 contact optical position sensing. The primary application is in page-based data input contexts 
such as form-filling and paper-based web interfaces and GUIs. The invention utilises a 
combined measurement of flie relative movement of a device in relation to a fixed surface and 
at feast one measurement of the absolute position of the device. Absolute measurement of 
position is preferably carried out using a position-encoded glyph bed embedded on the fixed 
10 surface. Based on the at least single absolute measuiement, tbe relative measurement of the 
devices movement, or stroke, is normalised to the property measure absolute position and tjhus 
substantial intenruptions in the detection of the absolute stroke position can be tolerated and 
corrected for. 
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24. A mefliod as claimed in any one of claims 1 to 12 and 21 to 23 farther including the 
step of providing feedback to a user as to whether the stroke detection is successful or not, 
preferably in real time. 

5 

25. A method as claimed in any one of claims 1 to 12 and 21 to 24 the method adapted to 
detect the absolute position of a pliirality of strokes, said strokes constituting writing, ^vherein 
sanity checking of the absolute position detection is performed based on a forward looidng 
probabilistic algorithm responsive to the physical writing environment and process, 

10 
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12, A measurement device for detemoinmg the time-varying absolute position of the 
device in respect to a sutfnce including: 

a first measuring device arranged to deteimjne at least one absolute position of the 
device in respect to tlie scrfece; 
5 a second measiiring device arranged to determine a time-varying vector representing 

the movement of tlie device in respect to Hie surface; 

processing means adapted to initialise the position of vector to the at least one absolute 
position rneasurement and output a signal representing the absolute position of the 
vector and thus the time-varyiDg absolute position of the device. 

10 

13, A measurement device for determining the absolute position of a stroke made by;;the 
measurement device in respect to a surface, said surface having embedded thereon position 
encoding indicia, the measurement device including: ^ : 

a first measuring device arranged to detect one or more position encoding indicia and 
1 5 determine at least one absolute position measurement of the device; 

in conjunction with the aforementioned step, a second measuring device arranged to 
measure the relative movement of the device in respect to the surface and output a 
time-varying motion vector representing the movement of the device in respect to^the 
surface; and 

20 processing means adapted to calculate the absolute location of the stroke in respect to 

the surface on the ba&is of the at least one measurement of the absolute position in 
combination with the measurement of the time-varying motion vector. 

14, A device as claimed in either claim 12 or 13 wherein tiie device includes a first and 
25 second optical system, the first adapted to image a glyph bed arran^d to encode die absolute 

position onto the stirface, and the second optical system adapted to determine the relative 
movement of die device in respect to the surfece. 
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15. A device as claimed m any one of claims 12 to 14 wherein first and second optical 
systems is Incorponited into a common optical sensing device. 

16. A device as claimed in any one of claims 12 to 15 wherein the device h^s a pen form- 
5 factor or alternatively, a mouse form-factor. 

r 

17. A device as claimed in any one of claims 12 to 16 wherfein the device includes 
additional support circuitry adapted to store stroke data. ^ 

JO 18, A device as claimed in any one of claims 12 to 16 v^4le^ein the device includes 
commanicatioiis circuitry adapted to transmit stroke data to a control means such as a 
computet. 

{ 

19. A device as claimed in any one of claims 12 to 18 vdiereinjthe device operates by 
15 bTrffering the stroke data for user-actLvated upload, or communicate ithe stroke datti in real- 
time, ox be responsive to a users command to upload stroke data to a c&ntrol means. 

20. A method as claimed in any one of claims 1 to 11 fixrfher including the step of, where 
the detection of absolute stroke position is interrupted, attempting to interpolate across the 

20 interrupted area* t 

i 

21. A method as claimed in any one of claims 1 to 1 1 and 20 ftirtHcr including the step of 
sanity checking interpolation and stroke reconstruction based on the statistically possible 
locations of strokes applied to the surface. ' 



25 



22. A method as claimed in any one of claims 1 to 1 1 and 20 to 21 further including the 
step of sanity checking absohite position measurements in respect of the sequence of stroke 
detection events of a surtace by reference to user ergonomics, physical size of the surface, 
type of stroke applied or the speed of application of the stroke. ! 
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Figure 1 
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Figure 4 



